Multimodal single-neuron, intracranial EEG, and fMRI brain responses during movie watching in human patients.

We present a multimodal dataset of intracranial recordings, fMRI, and eye tracking in 20 participants during movie watching. Recordings consist of single neurons, local field potential, and intracranial EEG activity acquired from depth electrodes targeting the amygdala, hippocampus, and medial frontal cortex implanted for monitoring of epileptic seizures. Participants watched an 8-min long excerpt from the video "Bang! You're Dead" and performed a recognition memory test for movie content. 3 T fMRI activity was recorded prior to surgery in 11 of these participants while performing the same task. This NWB- and BIDS-formatted dataset includes spike times, field potential activity, behavior, eye tracking, electrode locations, demographics, and functional and structural MRI scans. For technical validation, we provide signal quality metrics, assess eye tracking quality, behavior, the tuning of cells and high-frequency broadband power field potentials to familiarity and event boundaries, and show brain-wide inter-subject correlations for fMRI. This dataset will facilitate the investigation of brain activity during movie watching, recognition memory, and the neural basis of the fMRI-BOLD signal.

Reinforcement learning with associative or discriminative generalization across states and actions: fMRI at 3 T and 7 T.

The model-free algorithms of "reinforcement learning" (RL) have gained clout across disciplines, but so too have model-based alternatives. The present study emphasizes other dimensions of this model space in consideration of associative or discriminative generalization across states and actions. This "generalized reinforcement learning" (GRL) model, a frugal extension of RL, parsimoniously retains the single reward-prediction error (RPE), but the scope of learning goes beyond the experienced state and action. Instead, the generalized RPE is efficiently relayed for bidirectional counterfactual updating of value estimates for other representations. Aided by structural information but as an implicit rather than explicit cognitive map, GRL provided the most precise account of human behavior and individual differences in a reversal-learning task with hierarchical structure that encouraged inverse generalization across both states and actions. Reflecting inference that could be true, false (i.e., overgeneralization), or absent (i.e., undergeneralization), state generalization distinguished those who learned well more so than action generalization. With high-resolution high-field fMRI targeting the dopaminergic midbrain, the GRL model's RPE signals (alongside value and decision signals) were localized within not only the striatum but also the substantia nigra and the ventral tegmental area, including specific effects of generalization that also extend to the hippocampus. Factoring in generalization as a multidimensional process in value-based learning, these findings shed light on complexities that, while challenging classic RL, can still be resolved within the bounds of its core computations.

Caltech Conte Center, a multimodal data resource for exploring social cognition and decision-making.

This data release of 117 healthy community-dwelling adults provides multimodal high-quality neuroimaging and behavioral data for the investigation of brain-behavior relationships. We provide structural MRI, resting-state functional MRI, movie functional MRI, together with questionnaire-based and task-based psychological variables; many of the participants have multiple datasets from retesting over the course of several years. Our dataset is distinguished by utilizing open-source data formats and processing tools (BIDS, FreeSurfer, fMRIPrep, MRIQC), providing data that is thoroughly quality checked, preprocessed to various extents and available in multiple anatomical spaces. A customizable denoising pipeline is provided as open-source code that includes tools for the generation of functional connectivity matrices and initialization of individual difference analyses. Behavioral data include a comprehensive set of psychological assessments on gold-standard instruments encompassing cognitive function, mood and personality, together with exploratory factor analyses. The dataset provides an in-depth, multimodal resource for investigating associations between individual differences, brain structure and function, with a focus on the domains of social cognition and decision-making.

Associations between testosterone, estradiol, and androgen receptor genotype with amygdala subregions in adolescents.

Much is known about the development of the whole amygdala, but less is known about its structurally and functionally diverse subregions. One notable distinguishing feature is their wide range of androgen and estrogen receptor densities. Given the rise in pubertal hormones during adolescence, sex steroid levels as well as receptor sensitivity could influence age-related subregion volumes. Therefore, our goal was to evaluate the associations between the total amygdala and its subregion volumes in relation to sex hormones - estradiol and free testosterone (FT) - as a function of age and genetic differences in androgen receptor (AR) sensitivity in a sample of 297 adolescents (46% female). In males, we found small effects of FT-by-age interactions in the total amygdala, portions of the basolateral complex, and the cortical and medial nuclei (CMN), with the CMN effects being moderated by AR sensitivity. For females, small effects were seen with increased genetic AR sensitivity relating to smaller basolateral complexes. However, none of these small effects passed multiple comparisons. Future larger studies are necessary to replicate these small, yet possibly meaningful effects of FT-by-age associations and modulation by AR sensitivity on amygdala development to ultimately determine if they contribute to known sex differences in emotional neurodevelopment.

Reorganization of the Social Brain in Individuals with Only One Intact Cerebral Hemisphere.

Social cognition and emotion are ubiquitous human processes that recruit a reliable set of brain networks in healthy individuals. These brain networks typically comprise midline (e.g., medial prefrontal cortex) as well as lateral regions of the brain including homotopic regions in both hemispheres (e.g., left and right temporo-parietal junction). Yet the necessary roles of these networks, and the broader roles of the left and right cerebral hemispheres in socioemotional functioning, remains debated. Here, we investigated these questions in four rare adults whose right (three cases) or left (one case) cerebral hemisphere had been surgically removed (to a large extent) to treat epilepsy. We studied four closely matched healthy comparison participants, and also compared the patient findings to data from a previously published larger healthy comparison sample (n = 33). Participants completed standardized socioemotional and cognitive assessments to investigate social cognition. Functional magnetic resonance imaging (fMRI) data were obtained during passive viewing of a short, animated movie that distinctively recruits two social brain networks: one engaged when thinking about other agents' internal mental states (e.g., beliefs, desires, emotions; so-called Theory of Mind or ToM network), and the second engaged when thinking about bodily states (e.g., pain, hunger; so-called PAIN network). Behavioral assessments demonstrated remarkably intact general cognitive functioning in all individuals with hemispherectomy. Social-emotional functioning was somewhat variable in the hemispherectomy participants, but strikingly, none of these individuals had consistently impaired social-emotional processing and none of the assessment scores were consistent with a psychiatric disorder. Using inter-region correlation analyses, we also found surprisingly typical ToM and PAIN networks, as well as typical differentiation of the two networks (in the intact hemisphere of patients with either right or left hemispherectomy), based on idiosyncratic reorganization of cortical activation. The findings argue that compensatory brain networks can process social and emotional information following hemispherectomy across different age levels (from 3 months to 20 years old), and suggest that social brain networks typically distributed across midline and lateral brain regions in this domain can be reorganized, to a substantial degree.

Microstructural properties within the amygdala and affiliated white matter tracts across adolescence.

The amygdala is a heterogenous set of nuclei with widespread cortical connections that continues to develop postnatally with vital implications for emotional regulation. Using high-resolution anatomical and multi-shell diffusion MRI in conjunction with novel amygdala segmentation, cutting-edge tractography, and Neurite Orientation Dispersion and Density (NODDI) methods, the goal of the current study was to characterize age associations with microstructural properties of amygdala subnuclei and amygdala-related white matter connections across adolescence (N = 61, 26 males; ages of 8-22 years). We found age-related increases in the Neurite Density Index (NDI) in the lateral nucleus (LA), dorsal and intermediate divisions of the basolateral nucleus (BLDI), and ventral division of the basolateral nucleus and paralaminar nucleus (BLVPL). Additionally, there were age-related increases in the NDI of the anterior commissure, ventral amygdalofugal pathway, cingulum, and uncinate fasciculus, with the strongest age associations in the frontal and temporal regions of these white matter tracts. This is the first study to utilize NODDI to show neurite density of basolateral amygdala subnuclei to relate to age across adolescence. Moreover, age-related differences were also notable in white matter microstructural properties along the anterior commissure and ventral amydalofugal tracts, suggesting increased bilateral amygdalae to diencephalon structural connectivity. As these basolateral regions and the ventral amygdalofugal pathways have been involved in associative emotional conditioning, future research is needed to determine if age-related and/or individual differences in the development of these microstructural properties link to socio-emotional functioning and/or risk for psychopathology.

Restructuring of amygdala subregion apportion across adolescence.

Total amygdala volumes develop in association with sex and puberty, and postmortem studies find neuronal numbers increase in a nuclei specific fashion across development. Thus, amygdala subregions and composition may evolve with age. Our goal was to examine if amygdala subregion absolute volumes and/or relative proportion varies as a function of age, sex, or puberty in a large sample of typically developing adolescents (N = 408, 43 % female, 10-17 years). Utilizing the in vivo CIT168 atlas, we quantified 9 subregions and implemented Generalized Additive Mixed Models to capture potential non-linear associations with age and pubertal status between sexes. Only males showed significant age associations with the basolateral ventral and paralaminar subdivision (BLVPL), central nucleus (CEN), and amygdala transition area (ATA). Again, only males showed relative differences in the proportion of the BLVPL, CEN, ATA, along with lateral (LA) and amygdalostriatal transition area (ASTA), with age. Using a best-fit modeling approach, age, and not puberty, was found to drive these associations. The results suggest that amygdala subregions show unique variations with age in males across adolescence. Future research is warranted to determine if our findings may contribute to sex differences in mental health that emerge across adolescence.

No strong evidence that social network index is associated with gray matter volume from a data-driven investigation.

Recent studies in adult humans have reported correlations between individual differences in people's Social Network Index (SNI) and gray matter volume (GMV) across multiple regions of the brain. However, the cortical and subcortical loci identified are inconsistent across studies. These discrepancies might arise because different regions of interest were hypothesized and tested in different studies without controlling for multiple comparisons, and/or from insufficiently large sample sizes to fully protect against statistically unreliable findings. Here we took a data-driven approach in a pre-registered study to comprehensively investigate the relationship between SNI and GMV in every cortical and subcortical region, using three predictive modeling frameworks. We also included psychological predictors such as cognitive and emotional intelligence, personality, and mood. In a sample of healthy adults (n = 92), neither multivariate frameworks (e.g., ridge regression with cross-validation) nor univariate frameworks (e.g., univariate linear regression with cross-validation) showed a significant association between SNI and any GMV or psychological feature after multiple comparison corrections (all R-squared values ≤ .1). These results emphasize the importance of large sample sizes and hypothesis-driven studies to derive statistically reliable conclusions, and suggest that future meta-analyses will be needed to more accurately estimate the true effect sizes in this field.

Brain Differences in the Prefrontal Cortex, Amygdala, and Hippocampus in Youth with Congenital Adrenal Hyperplasia.

CONTEXT: Classical congenital adrenal hyperplasia (CAH) due to 21-hydroxylase deficiency results in hormone imbalances present both prenatally and postnatally that may impact the developing brain. OBJECTIVE: To characterize gray matter morphology in the prefrontal cortex and subregion volumes of the amygdala and hippocampus in youth with CAH as compared to controls. DESIGN: A cross-sectional study of 27 CAH youth (16 female; 12.6 ±â€…3.4 years) and 35 typically developing, healthy controls (20 female; 13.0 ±â€…2.8 years) with 3-T magnetic resonance imaging scans. Brain volumes of interest included bilateral prefrontal cortex and 9 amygdala and 6 hippocampal subregions. Between-subject effects of group (CAH vs. control) and sex, and their interaction (group-by-sex) on brain volumes, were studied while controlling for intracranial volume (ICV) and group differences in body mass index and bone age. RESULTS: Congenital adrenal hyperplasia youth had smaller ICV and increased cerebrospinal fluid volume compared to controls. In fully-adjusted models, CAH youth had smaller bilateral superior and caudal middle frontal volumes, and smaller left lateral orbitofrontal volumes compared to controls. Medial temporal lobe analyses revealed that the left hippocampus was smaller in fully-adjusted models. Congenital adrenal hyperplasia youth also had significantly smaller lateral nucleus of the amygdala and hippocampal subiculum and CA1 subregions. CONCLUSIONS: This study replicates previous findings of smaller medial temporal lobe volumes in CAH patients and suggests that the lateral nucleus of the amygdala, as well as subiculum and subfield CA1 of the hippocampus, are particularly affected within the medial temporal lobes in CAH youth.

Causal mapping of emotion networks in the human brain: Framework and initial findings.

Emotions involve many cortical and subcortical regions, prominently including the amygdala. It remains unknown how these multiple network components interact, and it remains unknown how they cause the behavioral, autonomic, and experiential effects of emotions. Here we describe a framework for combining a novel technique, concurrent electrical stimulation with fMRI (es-fMRI), together with a novel analysis, inferring causal structure from fMRI data (causal discovery). We outline a research program for investigating human emotion with these new tools, and provide initial findings from two large resting-state datasets as well as case studies in neurosurgical patients with electrical stimulation of the amygdala. The overarching goal is to use causal discovery methods on fMRI data to infer causal graphical models of how brain regions interact, and then to further constrain these models with direct stimulation of specific brain regions and concurrent fMRI. We conclude by discussing limitations and future extensions. The approach could yield anatomical hypotheses about brain connectivity, motivate rational strategies for treating mood disorders with deep brain stimulation, and could be extended to animal studies that use combined optogenetic fMRI.

Intrinsic Functional Connectivity of the Brain in Adults with a Single Cerebral Hemisphere.

A reliable set of functional brain networks is found in healthy people and thought to underlie our cognition, emotion, and behavior. Here, we investigated these networks by quantifying intrinsic functional connectivity in six individuals who had undergone surgical removal of one hemisphere. Hemispherectomy subjects and healthy controls were scanned with identical parameters on the same scanner and compared to a large normative sample (n = 1,482). Surprisingly, hemispherectomy subjects and controls all showed strong and equivalent intrahemispheric connectivity between brain regions typically assigned to the same functional network. Connectivity between parts of different networks, however, was markedly increased for almost all hemispherectomy participants and across all networks. These results support the hypothesis of a shared set of functional networks that underlie cognition and suggest that between-network interactions may characterize functional reorganization in hemispherectomy.

A high-resolution probabilistic in vivo atlas of human subcortical brain nuclei.

Recent advances in magnetic resonance imaging methods, including data acquisition, pre-processing and analysis, have benefited research on the contributions of subcortical brain nuclei to human cognition and behavior. At the same time, these developments have led to an increasing need for a high-resolution probabilistic in vivo anatomical atlas of subcortical nuclei. In order to address this need, we constructed high spatial resolution, three-dimensional templates, using high-accuracy diffeomorphic registration of T1- and T2- weighted structural images from 168 typical adults between 22 and 35 years old. In these templates, many tissue boundaries are clearly visible, which would otherwise be impossible to delineate in data from individual studies. The resulting delineations of subcortical nuclei complement current histology-based atlases. We further created a companion library of software tools for atlas development, to offer an open and evolving resource for the creation of a crowd-sourced in vivo probabilistic anatomical atlas of the human brain.

Distinct prediction errors in mesostriatal circuits of the human brain mediate learning about the values of both states and actions: evidence from high-resolution fMRI.

Prediction-error signals consistent with formal models of "reinforcement learning" (RL) have repeatedly been found within dopaminergic nuclei of the midbrain and dopaminoceptive areas of the striatum. However, the precise form of the RL algorithms implemented in the human brain is not yet well determined. Here, we created a novel paradigm optimized to dissociate the subtypes of reward-prediction errors that function as the key computational signatures of two distinct classes of RL models-namely, "actor/critic" models and action-value-learning models (e.g., the Q-learning model). The state-value-prediction error (SVPE), which is independent of actions, is a hallmark of the actor/critic architecture, whereas the action-value-prediction error (AVPE) is the distinguishing feature of action-value-learning algorithms. To test for the presence of these prediction-error signals in the brain, we scanned human participants with a high-resolution functional magnetic-resonance imaging (fMRI) protocol optimized to enable measurement of neural activity in the dopaminergic midbrain as well as the striatal areas to which it projects. In keeping with the actor/critic model, the SVPE signal was detected in the substantia nigra. The SVPE was also clearly present in both the ventral striatum and the dorsal striatum. However, alongside these purely state-value-based computations we also found evidence for AVPE signals throughout the striatum. These high-resolution fMRI findings suggest that model-free aspects of reward learning in humans can be explained algorithmically with RL in terms of an actor/critic mechanism operating in parallel with a system for more direct action-value learning.

The human amygdala parametrically encodes the intensity of specific facial emotions and their categorical ambiguity.

The human amygdala is a key structure for processing emotional facial expressions, but it remains unclear what aspects of emotion are processed. We investigated this question with three different approaches: behavioural analysis of 3 amygdala lesion patients, neuroimaging of 19 healthy adults, and single-neuron recordings in 9 neurosurgical patients. The lesion patients showed a shift in behavioural sensitivity to fear, and amygdala BOLD responses were modulated by both fear and emotion ambiguity (the uncertainty that a facial expression is categorized as fearful or happy). We found two populations of neurons, one whose response correlated with increasing degree of fear, or happiness, and a second whose response primarily decreased as a linear function of emotion ambiguity. Together, our results indicate that the human amygdala processes both the degree of emotion in facial expressions and the categorical ambiguity of the emotion shown and that these two aspects of amygdala processing can be most clearly distinguished at the level of single neurons.

In vivo delineation of subdivisions of the human amygdaloid complex in a high-resolution group template.

The nuclei of the human amygdala remain difficult to distinguish in individual subject structural magnetic resonance images. However, interpretation of the amygdala's role in whole brain networks requires accurate localization of functional activity to a particular nucleus or subgroup of nuclei. To address this, high spatial resolution, three-dimensional templates, using joint high accuracy diffeomorphic registration of T1- and T2-weighted structural images from 168 typical adults between 22 and 35 years old released by the Human Connectome Project were constructed. Several internuclear boundaries are clearly visible in these templates, which would otherwise be impossible to delineate in individual subject data. A probabilistic atlas of major nuclei and nuclear groups was constructed in this template space and mapped back to individual spaces by inversion of the individual diffeomorphisms. Group level analyses revealed a slight (∼2%) bias toward larger total amygdala and nuclear volumes in the right hemisphere. No substantial sex or age differences were found in amygdala volumes normalized to total intracranial volume, or subdivision volumes normalized to amygdala volume. The current delineation provides a finer parcellation of the amygdala with more accurate external boundary definition than current histology-based atlases when used in conjunction with high accuracy registration methods, such as diffeomorphic warping. These templates and delineation are intended to be an open and evolving resource for future functional and structural imaging studies of the human amygdala. Hum Brain Mapp 37:3979-3998, 2016. © 2016 Wiley Periodicals, Inc.

Idiosyncratic brain activation patterns are associated with poor social comprehension in autism.

Autism spectrum disorder (ASD) features profound social deficits but neuroimaging studies have failed to find any consistent neural signature. Here we connect these two facts by showing that idiosyncratic patterns of brain activation are associated with social comprehension deficits. Human participants with ASD (N = 17) and controls (N = 20) freely watched a television situation comedy (sitcom) depicting seminaturalistic social interactions ("The Office", NBC Universal) in the scanner. Intersubject correlations in the pattern of evoked brain activation were reduced in the ASD group-but this effect was driven entirely by five ASD subjects whose idiosyncratic responses were also internally unreliable. The idiosyncrasy of these five ASD subjects was not explained by detailed neuropsychological profile, eye movements, or data quality; however, they were specifically impaired in understanding the social motivations of characters in the sitcom. Brain activation patterns in the remaining ASD subjects were indistinguishable from those of control subjects using multiple multivariate approaches. Our findings link neurofunctional abnormalities evoked by seminaturalistic stimuli with a specific impairment in social comprehension, and highlight the need to conceive of ASD as a heterogeneous classification.

Effect of inversion recovery fat suppression on hepatic R2* quantitation in transfusional siderosis.

OBJECTIVE. The purpose of this study is to evaluate whether the application of spectral pre-saturation inversion recovery (SPIR) fat suppression in standard multiecho gradient-echo sequences has a significant effect on hepatic R2* quantitation in patients with iron overload syndromes. MATERIALS AND METHODS. Eighty patients were scanned with a multiecho gradient-echo sequence without and with the application of SPIR. Six different postprocessing approaches were used to extract R2* values for maximum generality. RESULTS. SPIR fat suppression lowered R2* values by 3.9-7.0% (p < 0.0001 in all pairwise comparisons), independently of the postprocessing algorithm. Coefficients of variation for R2* ranged from 4.5% to 10.0%. Regardless of the size of the ROI (area of homogeneous tissue or entire liver profile in the slice), pixelwise approaches combined with an exponential-plus-constant fitting model yielded the lowest coefficients of variation (4.5% and 5.1%), whereas truncated exponential fits of the averaged signals produced the highest coefficients of variation (7.8% and 10%). For R2* values exceeding 200 Hz, a Bland-Altman analysis showed a bias that grew linearly for all postprocessing methods. CONCLUSION. SPIR fat suppression resulted in systematically lower hepatic R2* estimates. Because calibration curves were derived using images without fat suppression, these biases should be corrected when reporting liver iron concentrations estimated from fat-suppressed multiecho T2*-weighted images.

A specific hypoactivation of right temporo-parietal junction/posterior superior temporal sulcus in response to socially awkward situations in autism.

People with autism spectrum disorder (ASD) often have difficulty comprehending social situations in the complex, dynamic contexts encountered in the real world. To study the social brain under conditions which approximate naturalistic situations, we measured brain activity with FUNCTIONAL MAGNETIC RESONANCE IMAGING: while participants watched a full-length episode of the sitcom The Office. Having quantified the degree of social awkwardness at each moment of the episode, as judged by an independent sample of controls, we found that both individuals with ASD and control participants showed reliable activation of several brain regions commonly associated with social perception and cognition (e.g. those comprising the 'mentalizing network') during the more awkward moments. However, individuals with ASD showed less activity than controls in a region near right temporo-parietal junction (RTPJ) extending into the posterior end of the right superior temporal sulcus (RSTS). Further analyses suggested that, despite the free-form nature of the experimental design, this group difference was specific to this RTPJ/RSTS area of the mentalizing network; other regions of interest showed similar activity across groups with respect to both location and magnitude. These findings add support to a body of evidence suggesting that RTPJ/RSTS plays a special role in social processes across modalities and may function atypically in individuals with ASD navigating the social world.

Dose titration of deferasirox iron chelation therapy by magnetic resonance imaging for chronic iron storage disease in three adult red bald-headed uakari (Cacajao calvus rubicundus).

Iron overload is common in lemurs and some New World nonhuman primates raised in captivity, but there is no such documentation in the red bald-headed uakari (Cacajao calvus rubicundus). This study describes postmortem documentation of severe iron storage disease in one red bald-headed uakari and the use of iron chelation with oral deferasirox in the three surviving members of the colony. Magnetic resonance imaging was used to quantify pretreatment iron burden and to follow the response to therapy in two females, 22 and 28 yr of age, and one male 33 yr of age. Baseline liver iron concentrations ranged from 16 to 23 mg/g dry weight. In humans, a liver iron concentration greater than 15 mg/g is considered severe and associated with endocrine and cardiac toxicity. The uakaris were otherwise asymptomatic, generally healthy, nonpregnant, and on a stable, low-iron diet. Quantitative magnetic resonance imaging indicated that dosage escalations up to 100 mg/kg were needed to produce meaningful reductions in iron stores. After 5 yr of therapy, two animals continue at a dosage of 100 mg/kg per day, and the third was transitioned to twice-weekly maintenance dosing because of successful de-ironing. The animals tolerated iron chelation therapy well, having stable hematologic, renal, and hepatic function profiles before, during, and after treatment. Deferasirox monotherapy may represent a therapeutic option in primates with iron storage disease when dietary measures are ineffective and phlebotomy is logistically challenging.